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PROBLEM TO BE SOLVED: To speedily and surely store various 
informationobtained from the actual worfdio a virtual worldand easily retrieve the 
information by generating keys indicating attributes and features of information of 
the actual world from the informationand relating and recording the information 
and keys. 

SOLUTION: The information processing system 1 obtains various information 
from the actual word 3 through an information acquiring means 2 and composes 
a data base of the obtained information to generate a virtual world 4. Furtherthe 
information processing system 1 outputs various information which is related with 
the actual world 3 from this virtual world 4 through an information output means 
5. Furtherthe Information processing system 1 when making the information into 
data makes a key generating means 7 generate keys consisting of key 
wordsspeech recognition resultstime informationetc.from the information 
acquired by a recording information generating means 6. With the keys the actual 
world 3 and virtual world 4 are linked to each other. 



CLAIMS 



[Claim(s)] 

[Claim 1]An information processor comprising: 

the attribute of information on the real world - and - or a key generation means 
to generate a key showing the feature. 

An information accumulation means which relates with link information 
constituted so that it could be decided from said two or more keys that it will be a 
meaningand records said information on a database. 

[Claim 2]The information processor according to claim 1 provided with an 
information storage means to generate said key from information on the real 
world acquired by information acquisition meansto associate said information and 
said keyand to record said information. 
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[Claim 3]The information processor comprising according to claim 1 : 

An information retrieval means which searches said database on the basis of 

said key. 

An information output means which outputs search results. 

[Claim 4]The information processor according to claim Iwherein said key 
generation means generates said key from a hour entry of said real world 
relevant to said information. 

[Claim 5]The information processor according to claim Iwherein said key 
generation means generates said key from coordinates which show a physical 
location of said real world relevant to said information. 
[Claim 6]The information processor according to claim Iwherein said key 
generation means generates said key from identification information which 
specifies those who inputted said informationor identification information which 
specifies a group to whom those who inputted said information belong. 
[Claim 7]The information processor according to claim Iwherein said information 
storage means constitutes at least a part of information network and said key 
generation means generates said key by identification information which 
specifies said information storage means. 

[Claim 8]The information processor according to claim Iwherein said key 
generation means generates said key from a picture of said real world relevant to 
said information. 

[Claim 9jThe information processor according to claim Iwherein said key 
generation means generates said key from an audio signal of said real world 
relevant to said information. 

[Claim 1 0jThe information processor according to claim 3wherein said 
information retrieval means changes said retrieving range according to density of 
said information belonging to a retrieving range. 
[Claim 1 1]The information processor according to claim 3wherein said 
information retrieval means and said information output means detect distribution 
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of said information and output a detection result, 

[Claim 1 2]The information processor according to claim 3wherein said 

information retrieval means and said information output means detect density of 

said information and output a detection result. 

[Claim 1 3]The information processor according to claim 3wherein said 

information retrieval means and said information output means classify and 

output said information. 

[Claim 14]The information processor according to claim 3wherein said 
information storage means adds identification information which specifies those 
who inputted said information and records said information and said key. 
[Claim 1 5]The information processor according to claim 14wherein said 
information retrieval means retrieves said information on the basis of said 
identification information. 

[Claim 16]The information processor according to claim 15wherein said 
information retrieval means and said information output means retrieve said 
information or output search results only to those who inputted said information 
on the basis of said identification information. 

[Claim 17]The information processor according to claim 2 to which said 
information retrieval means is characterized by searching said database 
according to a similar grade of said key. 

[Claim 18]The information processor according to claim 14wherein said 
information forms a series of information groups mutually related according to the 
arrangement of a time series. 

[Claim 19]The information processor according to claim 18wherein said key 
generation means and said information accumulation means record said 
information with a predetermined time interval and generate said a series of 
information groups. 

[Claim 20]The information processor according to claim 1 wherein at least one of 
said information acquisition meanssaid key generation meansand said the 
information storage means inputs or outputs said information by wire 
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communication means or a radio wire communication means. 
[Claim 21]The information processor according to claim 3wherein said key 
generation means and said information accumulation means record said 
information and generate a series of information groups related according to the 
arrangement of a time series according to change of said coordinates. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] in this inventions relates with the key which shows the 
attribute of inform ationand the feature about an information processorand said 
information is accumulated. 

For examplevarious kinds of information acquired from the real world is 
accumulated promptly and certainly to the virtual world formed of the information 
accumulated in the Internetand it enables it thereforeto retrieve the information 
on these various kinds simply. 

[0002) 

[Description of the Prior Artjln information networkssuch as the former and the 
Internetit is made as [ accumulate / by the hypermedia which becomes for 
various information associated organicaily / a variety of information ]and is made 
as [ provide / to the user who accesses these information by this / the virtual 
world formed of these information ]. 
[0003] 

[Probiem(s) to be Solved by the InventionJBy the wayin the Internet this kind of 
virtual worfdEn order to navigate and experience worldwide Webb (WWW:World 
Wide Web) and to acquire the information on this WebbAfter specifying URL 
(Uniform Resorce Locator) directly or accessing information based on other 
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URLit is necessary to follow a (ink. That iseven when information more useful 
than worldwide Webb can be acqutredii is necessary to specify the link on a 
virtual woridand there is a fault in which it is difficult to access information directly. 
[0004] If this kind of information can be accessed simply and certainly even if it 
does not know information required for access of this URLit will be thought that it 
is convenient, 

[0005] In this casein the variety of information provided by the InternetBy 
navigating a hyper-network and providing such a virtual world by the link which 
becomes by the organic correlation between each information By setting up the 
link which ties up this virtual world and real world it is thought that the variety of 
information which forms a virtual world in the real world is simply and certainly 
acquirable. By setting up such a linkthe variety of information acquired in the real 
world is accumulated in an information network simply and certainlyand it is 
thought that further more useful sources of information can be formed. By 
forming a direct link between the real world and a virtual world still in this waythe 
real world can be markedly extended to a target and it is thought that various 
useful services can be provided, 

[0006]As opposed to the virtual world formed of the information which this 
invention was made in consideration of the above pointand was accumulated in 
the information Internets is going to propose the information processor which can 
accumulate various kinds of information acquired from the real world promptly 
and certainly and with which the information on these various kinds can be 
retrieved simply. 
[0007] 

[Means for Solving the Problemjln order to solve this technical problemin this 
inventiona key showing the attribute of information to this information on the real 
world acquired by information acquisition means and the feature is generatedthis 
information and key are associated and recordedand a database is built using 
previous information. 

[0008]ff information on the real world acquired by information acquisition means 
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and a key showing the attribute of this information and the feature are associated 
and are recorded and put in a databaseA link can be formed from the reai world 
by the ability to make this key into a key to a virtual world formed of information 
put in a databaseandthereby various kinds of information can be accessed simpiy 
and certainly from the real world. 
[0009] 

[Embodiment of the InventionjHereafteran embodiment of the invention is 
explained in full detailreferring to drawings suitably. 

[001 03(1) The fundamental isneblock diagram 1 is a block diagram showing the 
basic constitution of the information processing system concerning an 
embodiment of the invention. In this information processing system 1a variety of 
information is acquired from the real world 3 via the information acquisition 
means 2and this acquired information is put in a databaseand the virtual world 4 
is formed. Furthermorethe information processing system 1 outputs the variety of 
information related with the real world from this virtual world via the information 
output means 5. Furthermorein the case of database creation of these 
informationthe information processing system 1 generates the key which shows 
the attribute of informationand the featureand forms the link between the real 
world and a virtual world by this key. Hereunlike the information generated by 
data processing of a computeretc. information acquirable by observation with 
various actual measuring machine machines etc. is called the information on the 
real world. 

[0011]The information acquisition means 2 inputs the information {for examplethe 
information on a sounda picturea textetc. corresponds and it is called main 
information below) put in a database from the real woridand inputs information 
required for key generation here if needed, it is possible to be able to consider a 
sounda picturethe information in a textetc. as main informationand to apply 
position informations hour entryetc. as information for key generation. 
[0012]The recorded information creating means 6 changes and outputs main 
information to a data format suitable for database creation. For examptein the 
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main information which becomes with an audio signalit changes into fiiessuch as 
WAV formatter changing this audio signal into a digital signal. In the main 
information which becomes with a video signalit changes into fiiessuch as JPEG 
and MPEG formatter changing into a digital signal similarly. 
[00l3]The key generation means 7 generates the key which becomes by 
keywordspeech recognition results hour entryetc. from the information acquired 
by the recorded information creating means 6. At this timeusing the key 
beforehand registered into the mapping database I2the key generation means 7 
generates a key so that it may correspond to these keys. The information 
accumulation means 8 accumulates and puts in a database the key which was 
carried out in this way and generatedand the main information outputted from the 
recorded information creating means 6. 

[0014]Namelywhen it compares to the WWW system on the Intemetthe database 
manager 9Main information is accumulated with the address by URL (Uniform 
Resorce Locator)the database 10 is formedand the main information 
accumulated by the demand from the information retrieval means 13 is read and 
outputted. Furthermoreat this timethe database manager 9So that it may 
correspond to the standard information (it becomes by the HTML (Hyper 
TextMakeup Language) document beforehand registered into the database 10 
corresponding to the service which this information processing system provides) 
registered beforehandMain information is file-ized by a HTML documentand is 
accumulated. 

[001 5] By recording a key and the corresponding URL address of main 
information in this case corresponding to the database manager 9and forming 
the mapping database 12the mapping database manager 1 1 relates with main 
informationand records a key. 

[0016]Thereby by this embodimentit is made as [ form / put main information in a 
database and / a virtual worid }. When it compares to worldwide Webb of the 
Internet in carrying outthe database manager 9 and the database 10 will 
correspond to the document to write and which is managed by a Web server and 
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this Web serverrespectiveiy. 

[00173Thereforetn the mapping database manager 11 the main information 
outputted from the information accumulation means 8 on the basis of the key 
corresponding to the standard information set up beforehand can be mapped in a 
virtual worldand the information acquired from the real world that much simply 
and promptly can be recorded. Contrary to thisthe database 10 can be accessed 
by a key and useful information can be simply acquired from a virtual world. 
[001 8] Namely the information retrieval means 13 is based on the key outputted 
from the key generation means 7 at the time of searchURL corresponding to this 
key is detected by accessing the mapping database 12 from the mapping 
database manager Hand searching the link corresponding to a key from the 
standard information corresponding to a user's demand. Furthermorethe 
information retrieval means 13 loads and outputs the main information stored in 
the database 10 by this URL 

[0019]The output information generation means 15 changes and outputs the 
print-out outputted from this information retrieval means 13 to the form which was 
adapted for the information output means. Thereby in the information output 
means Sit is made as [ output / to the real world / the main information which 
forms a virtual world ]. 

[00203(2) The 1st embodiment drawing 2 is a front view showing the terminal unit 
of the information processing system concerning a 1st embodiment of this 
invention. This terminal unit is a thin radio personal digital assistant deviceand 
the liquid crystal display panel 21 and the transparent tablet 22 are laminatedand 
it is arranged here at the frontlt is made as [ input / image dataa textand the 
menu for operation are displayed via this liquid crystal display panel 21 by thisa 
menu is selected via the transparent tablet 22and / a handwritten character ]. 
[0021]This liquid crystal display panel 21 is adjoinedthe microphone 23 is 
arrangedand it is made as [ input / via this microphone 23 / a sound ). 
Furthermorethe antenna 24 of a GPS (Global Positioning System) receiving set 
is arranged above this microphone 23and it is made as [ acquire / with the radio 
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signal received with this antenna 24 / currency information ]. Above this antenna 
24the lens 25 is arranged and it is made as [ picturize / via this lens 25 / various 
photographic subjects ]. 

[0022]Drawmg 3 is a block diagram of this terminal unit 20, This terminal unit 20 
contains the clock 26 as the information acquisition means 2and is made as 
[ acquire / the hour entry which becomes in current time by this ], The terminal 
unit 20 contains the GPS receiving set 27processes the signal received with the 
antenna 24and is made as [ acquire / three-dimensional position information ]. 
[0023jFurtherrnorethe terminal unit 20 is made as [ process / with CCD camera 
29 / the picture of the photographic subject which has the speech input system 
28 and CCD camera 29and processed the sound incorporated from the 
microphone 23 with this speech input system 28a nd was incorporated from the 
lens 25 J. It is made as [ detect / it has the pen input device 30and a handwritten 
character is inputted via the transparent tablet 22 by thisand / selection of a 
menu ]. By these information acquisition means 2the terminal unit 20As 
information on the real wortdit is made as [ acquire / a hour entryposition 
informationspeech information picture informationtextand the personal 
information that becomes by user ID further jand these information is used as 
information for generating main information and a key if needed. 
[0024]The terminal unit 20 is made as [ monitor / the sound which has the 
speech output unit 32and monitored the sound inputted with the speech input 
system 28 if needed as the information output means 5and was transmitted by 
the server ]. The terminal unit 20 has the liquid crystal display 33 constituted with 
the liquid crystal display panel 21 as the information output means 5The 
handwritten character which displayed various menus by this and was inputted 
via the pen input device 30 and CCD camera 29and a picture are checkedand it 
is made as [ display / various pictures further transmitted by the sen/era textetc. ]. 
[0025]The transmission and reception section 34 is the Radio Communications 
Department applied to a cellular phonelransmits a variety of information to a 
server by wireless transfer via the mobile phone fine network which becomes 
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with a public line by thisand receives various information from a server via this 
mobile phone line network. Thereby with this terminal unit 20it is made by 
communication with this transmission and reception section 34 as [ acquire / to 
the server side / with the area number of the ceil information used for ceil phone 
serviceand a telephone number / the currency information of this terminal unit 
20]. 

[0026]The system control part 35 becomes by computer which controls operation 
of this terminal unit 20 wholeaccesses a mobile phone line network via the 
transmission and reception section 34andthereby accesses a predetermined 
server via this mobile phone line network. The system control part 35 drives the 
liquid crystal display 33displays a menu screen required for operationand detects 
operation of this menu screen with the pen input device 30. Furthermore based 
on this detection resultthe information which drives the information acquisition 
means 2 and for which a user asks is acquiredand these information is 
transmitted to a server from the transmission and reception section 34. These 
information is outputted to the information output means 5 if needed at this 
timeand a user's check is urged. The variety of information transmitted by the 
server following a series of operations is outputted via the information output 
means 5. 

[0027]Various services are provided to the user who writes and who performs 
control of these series and operates this terminal unit 20 by this by 
communication with a server in the system control part 35 in carrying out. 
[0028] Prawing 4 a nd drawing 5 a re the biock diagrams showing the server 
connected with the terminal unit 20 via a mobile phone line networkdra } i 
shows the recording system of mam informattonand drawing [5 shows the 
reversion system of main information. This server 40 is connected with the server 
which forms the internet via the network 41. In this server 40a statement is 
omitted and explained about a terminal area with a mobile phone line networkand 
a terminal area with the Internet. 

[0029]That isin this server's 40 key generation means 7the voice recognition 
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equipment 42 carries out speech recognition processing of the audio signal 
transmitted from the terminal unit 20and analyzes the menu and text which the 
user inputted with the sound in the terminal unit 20 by this. The voice recognition 
equipment 42 is outputted to the key generation device 43 about a text among 
these. A characteristic portion is extracted from this picture by the image 
recognition device's 44 inputting the image data transmitted from the terminal unit 
20a nd carrying out processing image recognition of the picture formed of this 
image data. The text which furthermore expresses this extracted characteristic 
portion is generatedand this text is outputted to the key generation device 43. 
[0030]The key generation device 43 generates a key from these texts if needed. 
The key generation device 43 generates a key if needed also from the coordinate 
informationthe hour entrythe textand user ID which are obtained from the 
terminal unit 20. That iswhen a user demands the service about a user 
individualthe user ID which becomes by personal information is set as a key. "this 
place" which pinpoints a current position in addition to this - "this " - etc, - if a 
sound is inputted this user ID - in additioncoordinate information is set as a 
key. Thereby in the key generation means 7according to the service provided for 
a userit is single from the variety of information inputted from the terminal unit 
20or two or more kinds of keys are generated. 

[0031 ]ln the recorded information creating means 6the data format converter 45 
changes and outputs the voice data inputted directly or indirectly from the 
terminal unit 20text dataand image data to a data format suitable for database 
creation. The voice recognition equipment 46 carries out speech recognition 
processing of the audio signal inputted from the terminal unit 
20andtherebygenerates text data. 

[0032]The voice data compression equipment 47 carries out the data 
compression of the voice data inputted from the terminal unit 20outputs it to the 
data format converter 45and the image data compression device 48 carries out 
the data compression of the image data inputted from the terminal unit 20and it 
outputs it to the data format converter 45. 
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[0033] In this embodimentthe various files which the database manager 9 is 
formed of WWW server 49 of the internetand constitute a database are made as 
[ form / of a HTML document ]. 

[0034]Therebyby the server 40the picturesoundand text which were acquired in 
the terminal unit 20 are set as main informationand it is made as [ put / relate 
with the key by the coordinate information and the hour entry which show the 
attribute of main informationthe picture which becomes by main inform ationa 
sound and the key which shows the feature of a textand }. 
[0035]On the other handin the output information generation means 15the data 
format converter 50 (drawing 6) changes into the original data format the various 
main information searched from the database 10 via the information retrieval 
means 13 conversely [ the data format converter 45 in the recorded information 
creating means 6 ]. The voice synthesizer 51 outputs the contents of the text 
data with a sound among the main information which did in this way and was 
changed into the original data format by voice synthesis. 
[0036]Conversely [ the voice data compression equipment 47 and the image data 
compression device 48 ]the voice data restoration device 52 and the image data 
restoration device 53 carry out data decompression of the voice data and the 
image data by which the data compression was carried outand output them. 
Therebythe output information generation means 15 outputs the variety of 
information put in a database and recorded to the terminal unit 20 according to 
the original form. 

[0037] Various services are provided by [ which write ] controlling the whole 
operation by a computer in the server 40 in carrying outcommunicating with the 
terminal unit 20other serversetc. by this computerand performing a series of 
procedure. 

[G038](2-1 ) Town guide service * \s a flow chart which shows the 
server's 40 procedure when a user selects the menu of town guide service in the 
initial menu screen of the terminal unit 20. In this procedurethe server 40 moves 
to step SP2 from step SPIand demands the input of a service object from a user 
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via the terminal unit 20 by the voice response by voice synthesiser the display of 
a text. 

[0039] If a user inputs the text of "the restaurant of this neighborhood" with a 
soundfor examplethe server 40 will change this sound into a text via the voice 
recognition equipment 42 here. The server 40 detects this input by the key 
generation means 7when the menu set up beforehand is selected via the image 
recognition device 44 when a user inputs this wording by a handwritten inputand 
the same menu is selected. 

[0040]Thusif a user inputs a service objectsimultaneouslyfrom the terminal unit 
20the server 40 will acquire position information and a hour entryand will output 
to the key generation means 7. In the key generation means 7a key is generated 
from such speech information position inform ationand a hour entry by making into 
a key the key registered beforehand. Corresponding to a service objectthe key 
generation device 43 sets position information and a restaurant as a keyand 
outputs this key to the information retrieval means 13 here. That isthe server 40 
sets coordinate information as the key which shows a retrieving range from 
wording of "this neighborhood" which pinpoints the area. Furthermorethe 
keyword of the "restaurant" which specifies an object similarly is set as a key 
from wording of a "restaurant." 

[0041 jln the information retrieval means I3via the mapping database manager 
11 the mapping database 12 is searched and it investigates what information 
exists in the range beforehand set as this town guide service on the basis of a 
user's current position by the key which shows a retrieving range. Therebythe 
information retrieval means 13 calculates the density of the information about the 
"restaurant" of "this neighborhood" specified by the user. 
[0042]Thenit moves to step SP3 and the information retrieval means 13 
determines the user who carries the terminal unit 20and the retrieving range 
which was further suitable for the display of the portable instalment 20 from a 
calculation result in step SP2. In this determined retrieving rangevia WWW 
server 49the information retrieval means 13 searches a database and acquires a 
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corresponding HTML document. Furthermore in step SP4 continuingthe 
information retrieval means 13 from this acquired HTML document. After 
generating a HTML document with the generation method corresponding to a 
user's question and outputting this generated HTML document to the output 
information generation means 15it moves to step SP5 and this procedure is 
ended. 

[0043] In this casein the information retrieval means 13it corresponds to the 
question of "the restaurant of this neighborhood" whether the user inputtedA 
HTML document is generated so that the position of the restaurant of this 
neighborhood may be pinpointed on a mapand as this shows drawtng /this map 
is displayed on the display screen of the terminal unit 20. In the display shown in 
this dra w ing 7the information retrieval means 13 expresses evaluation of each 
restaurant accumulated in each database 10 according to color. 
[0044] By following a corresponding HTML document anew corresponding to a 
user's operationif a user specifies a restaurant and furthermore operates 
predetermined operation on this map in the server 40As shown in drawing 
Sdetailed information is displayed about the restaurant which the user chose. 
Furthermorein this dispiayabout related guidancewhen a menu (it becomes in a 
"map" and "the voice of evaluation") is displayed with an underline and these 
displays are chosenthe guidance which follows a link similarly and corresponds is 
displayed, 

[0045]On the other handif a user inputs a question with "the restaurant performed 
at this one week'lhe information retrieval means 13 will generate a key from the 
key which shows a retrieving range on the basis of the current time which 
becomes by a hour entry with the procedure mentioned above about drawing 
Sand the user ID which becomes by personal information further. The density of 
the information about the restaurant which furthermore searched the mapping 
database 12 on the basis of these keysand the user in this range for one week 
visited is caicuiatedand a retrieving range is anew set up from this calculation 
result if needed. Furthermoreby this retrieving rangethe database 10 is 
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searcheda HTML document is generated from these search resuttsand as this 
shows drawing 9information more detailed than the latest information one by one 
is displayed about the restaurant which the user visited in one week of the past. 
About the guidance in which the link is stretched also in this caseit displays with 
an underline and a user's user-friendliness is improved, 
[0046]When a user inputs a question with "a favorite restaurant" the information 
retrieval means 13The keyword of the "restaurant" which similarly sets the user 
ID which becomes by personal information as the key of a retrieving rangeand 
specifies an object in a similar manner from wording of a "restaurant" with the 
procedure mentioned above about drawing 6 is set as a key. The density of the 
information about a restaurant is calculated by furthermore searching the 
mapping database 12and the range made into a retrieval object from the high 
restaurant of evaluation if needed is set up from this calculation result. As the 
database 10 is searcheda HTML document is generated and this shows drawing 
10 from these search results by the range furthermore made into this retrieval 
objeetdetaiied information is displayed about a user's favorite restaurant. 
[0047]lf a user furthermore inputs a question with "the restaurant near 
Gotanda"simllarlywith the procedure mentioned above about drawing 6the 
information retrieval means 13 interprets the tab control specification of 
Gotandaand the coordinate information of this Gotanda will be set as the key of a 
retrieving rangeand it will set the keyword of a "restaurant" as a key. After 
resetting a retrieving range if needed furthermoreas the database 10 is searched 
simiiariya HTML document is generated and this shows drawing 11 from these 
search resultsthe restaurant near Gotanda is displayed. 
[0048]Furthermorewhen a user asks a question "evaluation" after these 
questionsthe range of search is similarly set up with the procedure mentioned 
above about drawing Band it is the range of a prescribed period on the basis of 
current time from the density of information in this caseThe database 10 is 
searchedand the list of messages about these restaurants is displayed as shown 
in drawing 1 2. In this casefrom the density of informationit searches in the range 
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which can be displayed on the terminal unit 20and search results are displayed. 
The message iist which other users left about the restaurant which the user 
specified is displayed with the mark which shows the form of the user namea 
dateand data. Incidentally what depends on a text what depends by the mark of a 
loudspeaker what depends a data format on a sound on a handwritten character 
by the mark of a pencil and a paper is displayed by the mark of a keyboard. 
[0049]Furthermore the server 40 is in the state which displayed this message 
Sistif a user specifies the number displayed at the head of a listthe link stretched 
by this number 1 will be foilowedthe database 10 will be searchedand the 
message assigned to this number wilt be notified. On the other handa demand of 
service of a message map will express these message lists as a map on 
displayas shown in drawing [13. If a user demands service of a message map at 
this time where the map mentioned above about drawing 7 is displayedthe range 
of search is expandedas shown in drawing 14distribution of the information which 
becomes by a message will be displayed by the position on a mapand the 
density of information will be displayed according to color-respectively, in this 
drayyjng 14the round mark of an ellipse form shows the number of information [ in 
/ again / for the whereabouts of each information / by the existence of hatching / 
an every place point ]. Thereby by the server 40the density of information and 
distribution are detectedsearch results are outputtedand it is made as [ improve / 
a user's user-friendliness ]• 

[0050] 8y thisin a userfrom the real worldthe virtual reality world will be accessed 
simply and a virtual world will be freely navigated by the connection with the real 
world in this virtual reality world. Thereforein a uservarious information which 
surrounds self in the real world can be acquired more simply than the database 
10 and certainlyand these information can be used effectively. That isin an art 
gallerya museumetc.a bar codean identification codeetc. which used as the key 
the picture acquired by picturizing exhibition data directly or were added to 
exhibition data can be used as a keyand various information relevant to a display 
object can also be acquired simply on that spot 
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[0051 ]ln buiidingssuch as a department storeetc.simiiarlyif it is in a theater etc. 
about informationincluding counter guidancedescription of 
itemetc.againinformationinciuding a public performance schedule etc.is 
acquirable. Furthermorethe neighboring medical institution according to condition 
of disease can also be chosen by keyssuch as place of business and a house. St 
can also use for guidance and sightseeing guidance in a travel etc. Orienteering 
which used the terminal unit 20 as furthermore distributed to the specific area 
and could present various information one by one to this user can also be carried 
out. 

[0052]On the information which combined and was related with the real 
worldsuch as a mapas shown in drawing 14the whereabouts of the information 
made into the purpose is promptly acquirable in connection with the real world by 
having displayed distribution of informationand density. That isif the scenic spot 
in which it replaced with the message and hid by the place of image data where 
registration density is high can also be shown and it is in an art gallery etc. a 
popular work can also be simply found out by the place of a message where 
registration density is high. 

[00533(2-2} Message service dt ng 1 is a flow chart which shows the 
procedure of the message service which assigns a user's message etc. which 
were mentioned above about drawing 12 to main informationand registers them 
The server 40 will perform this procedureif a user selects a predetermined menu. 
That isas for the server 40if a user inputs the text of a "message service" into 
step SP1 1 with a sound from step SPIOfor examplethe server 1 will change this 
sound into a text via the voice recognition equipment 42. The server 1 detects 
this input by the key generation means 7when the menu set up beforehand is 
selected via the image recognition device 44 when a user inputs this wording by 
a handwritten inputand the same menu is selected. 

[0054]Thusif a user demands servicethe server 40 will acquire a user's message 
by the recorded information acquisition means 2 by the sound or a handwritten 
input. Furthermorethe server 40 generates simultaneously URL which records a 
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message from these keys on the basis of the key which becomes by position 
informationa hour entryand user ID from the terminal unit 20. When a user inputs 
"this restaurant" in a sound or a textat this timein the server 40 the server 40a 
"piace is pinpointed - this " - from wordingthe related key already registered into 
the mapping database 12 on the basis of a user's current position is searchedand 
a check is urged. By ambiguous retrievals key similar to wording of the 
continuing "restaurant" is collectively searched at this timeand a check is urged. 
[0055]When a user's check is obtained herecontinuously the server 401 1 moves to 
step SP12and by WWW server 49the HTML document corresponding to this 
message is createdthe message of the user who continues by this and inputs is 
set as main inform ationand it registers with the database 10. Thenin step 
SP13the server 40 attaches relationrecords such keys and URL on the mapping 
database 12and he forms a link so that main information can be accessed to a 
key by this at a key. Therebythe server 40 moves to step SP14 and ends this 
procedure. 

[0056]Main information which this acquired from the real worldsuch as a sounda 
pictureand a characters simply and certainly recordable on the virtual reality 
world by correlation with a key. Thereforeas all the users can be provided with 
this main informations can use for a messagea complaint receptionistetc. to a 
subject specific in this way. It can open wide only to the specific terminal unit 
which a fixed group usesfor examplesubstitution service of a built-in scratch pad 
can be provided for a hotel etc. It can open wide only to a fixed group and service 
of a conference room can also be provided. 

[00573(2-3) DEJABU service drawing 18 is a top view showing the display screen 
of the gestalt terminal in this server's 40 DEJABU service. In the server 40this 
DEJABU service is provided following a user's selection operation. This DEJABU 
service is service which sets this user ID as one of the keyssets the main 
information inputted by this user as access difficulty from other usersand is put in 
a database here. 

[0058]For this reasonin this DEJABU servicewhen the server 40 records URL on 
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the mapping database 12 he sets the flag which sets up the right to access. When 
accessing main information in common with other servicesthe flag of this right to 
access is checkedwhen the fiag is set hereuser ID is compared andonly in the 
case of the person himself/herselfmain information is accessed. 
[0059]in this servicefrom the terminal unit 20the server 40 sets at least one of 
picture informationspeech informationand the texts as main informationacquires 
these main information with a hour entryposition informationand personal 
informationand stores in the database 10 by a HTML document here. At this 
timethe server 40 generates a key by this hour entryposition informationand 
persona! informationand holds this key to the mapping database 12. 
[OOOOJTherebyin a userrecord of a trip can be put in a database simpiyfor 
exampieit can leave recordand this can be used later. This main information put 
in a database can be accessed by the ability to use coordinate information as a 
key in the visited partand the impression at that timeetc. can be checked in a 
picturea soundand a text about the place visited in the past. The tourist resort 
visited to a number of years or a front can also be checked. It can use also for 
guidance at the place furthermore visited once. 



display screen if a user selects the menu of a voice messagein the terminal unit 
20it wili incorporate a user's sound inputted continuously. A user's selection of 
the menu of a still picture will acquire the image data of a stiil picture in the 
terminal unit 20 by operation of the continuing user. 

[0062]Thenin the terminal unit 20if the menu of record is selectedafter connecting 
a circuit among the servers 40the message and image data which were 
incorporated will be transmitted with the information on key generation. A user's 
sound which uses coordinate informationa hour entryand personal information as 
a key in the server 40 following thiscontinuesand is inputtedand a still picture are 
recorded on the database 10. [0063}On the other handin the server 40a user's 
selection of the menu of search will search and provide a user individual's 
message which used coordinate information as the key and was registered in the 




lows the initial screen of this serviceand in this 
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pasta pictureand a text. At this timein a serve ra retrieving range will be 
changeddistribution of this individual user's information will be displayed about 
this neighborhoodand this wili tell the past gait to a user with the impression 
which the user left. 

[0064]On the other handif the menu of a relation database is seSectedin the 
server 40coordirtate information is used as a keysame procedure is performed 
with having mentioned above about drawing Sand various services as this shows 
to drawing 17 are provided. When a user selects the menu of this relation 
database here in the Enoshima neighborhoodThe initial screen at the time of 
displaying the document which described the information guide of the Enoshima 
neighborhood by this key is shownand "sightseeing guidance"a "transportation 
guide"and the "weather guidance" are displayed as information which can be 
provided respectively. A menu selectable otherwise is displayed on the lower 
column, 

[0065]On the other handin the initial screen of DEJABU serviceif the menu of 
automatic recording which is not illustrated is selectedif coordinate information 
changes beyond in constant valuein the terminal unit 20the image data of a still 
picture and voice data will be acquired automatically. Furthermorethe terminal 
unit 20 connects a circuit with the server 40and transmits this image data that 
were acquired. In the server 40this image data is recorded on the database 
10and a corresponding key is recorded on the mapping database 12. In the 
server 40the name of a place of a tourist resort applicable in a text on the basis 
of this coordinate information is collectively recorded by a key in this case. 
Thereby in this DEJABU serviceit is made as f record / a gait ] without being 
conscious of existence of the terminal unit 20 in any way. 
[0066] Drawing 18 shows the initial screen in the case of checking later the 
contents recorded by this automatic recordingand it is shown that two sheets and 
one message are registered for inhibition drawing in this case. 
[0067] (2-3) In service of scratch pad service ** of a trip the server 40Coordinate 
information and a hour entry are made only the person himself/herself accessible 
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like above-mentioned DEJABU service at a keyThe name of a place of the tourist 
resort detected from coordinate information is collectively used as a keythe text 
by a user's handwritten input is recordedand this forms a user's diary and the 
scratch pad of a trip with a database, Thereby in the server 40the user is freely 
made as [ retrace / the past memory ]. 

[00683(2-4) In service of ********************** a server puts in a database the 
message inputted from the terminal unit 20. Furthermorein addition to coordinate 
information and a hour entry a key is set up by the personal information which 
becomes by a message object at this timeand the flag of the right to access is set 
further. Therebyin the server 40only to access from a message objectthis user's 
sound is outputted and service of a message dial is provided. 
[00693(2-4) by relating the information acquired from the real world with the key 
generated from the information on the real world in the similar mannerand putting 
it in a database according to the composition beyond the effect of a 1st 
embodimentA link can be formed between the real world and a virtual world by 
the ability to make this key into a keyand effective various information can be 
acquired simply and promptly by thisand it can record. 
[00703(3) In other embodimentsin addition above-mentioned 
embodimentsalthough the case where a terminal unit was constituted so that 
acquisition of picture inform ationspeech inform ationand text information is 
possible was describedthis invention may set only not only this but speech 
information as main information. In this casein a personal digital assistant and a 
serveras shown in drawing 19 and drawing 20 it is constituted. 
[0071 jln an above-mentioned embodimentaithough the case where the keyword 
by speech information and text information was set as a keyand coordinate 
information and a hour entry generated a key was describedthis invention may 
generate a key not only from this but from picture inform ationand is good also 
considering the speech information itself as a key. If it does in this wayby setting 
the similarity of a key as a judging standard and accessing a databasethe similar 
scenerythe similar personthe music listened to beforeetc. can also be searched. 
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[0072] In a further above-mentioned embodimentalthough the case where hour 
entry personal information etc. generated a key was describedthis invention may 
set up the key which shows the attribute of main information by the site which 
becomes not only by this but by an information storage meansthe domain to 
pinpointetc, 

[00733A!though interactive mode described the case where search results were 
outputted corresponding to the retrieval required of 1 from a userin the above- 
mentioned embodimentthis invention like [ not only in this but the case offer 
exampiesearching the restaurant near thisand a tavern JAIso when searching 
collectively to two or more kinds of retrieval required it can apply widely. The 
searched main information will be classified and displayed on the server side in 
this case. 

[0074]Although the case where main information was put in a database by a 
HTML document was described in the further above-mentioned embodimentThis 
invention can be widely appliedwhen it puts main information in a database not 
only by this but by various file formatsand searching this main information with 
various techniques further. 

[0075] In a further above-mentioned embodimentalthough the case where various 
services were provided for the user who operates a radio personal digital 
assistant with the application of this invention was describedthis invention is 
widely applicable also not only to this but the fixed terminal unit. 
[0076] In a further above-mentioned embodimentalthough the case where a 
database was built on worldwide Webb was describedthis invention is widely 
applicable to the information processor which equipped further not only this but 
various information networks with the information storage means. 
[0077] 

[Effect of the InventionJBy relating the information acquired from the real world 
with the key which shows the attribute of this inform ationand the featureand 
accumulating it according to this inventionas mentioned aboveVarious kinds of 
information acquired from the real world can be accumulated promptly and 
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certainly to the virtual world formed of various informationand the information on 
these various kinds can be retrieved simply. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing Ijlt is a block diagram showing the outline composition of the 
information processing system concerning an embodiment of the invention, 
[Drawing 2]l t is a top view showing the terminal unit concerning a 1st 
embodiment of this invention. 

[Drawing 3] it is a block diagram showing the terminal unit of drawing 2, 
[Drawing 4jlt is a block diagram showing the recording system of the server etc. 
which are connected with the terminal unit of drawing 2. 

vving 5] | It is a block diagram showing the reversion system of drawing 4. 
[Drawing Jp is a flow chart which shows the procedure of information retrieval in 
the server of drawing 5 

St is a front view of the terminal unit in which the search results of 
drawing 8 are shown. 

[Drawing 8] it is a front view of the terminal unit in which the search results 
following drawing 7 are shown. 

[Drawing 9] it is a front view of the terminal unit in which the display of a retrieval 
list is shown. 

is a fr° nt view of tne terminal unit in which the display of the list 
following drawing 9 is shown. 

It is a front view of the terminal unit in which the display of other 
search results is shown. 

[Drawing \ 21 it is a front view of the terminal unit in which the display of the list of 
evaluations is shown. 

[Drawing 13] It is a front view of the terminal unit in which the display which 
968046/D/1 



expressed \ 1 2 on the map is shown. 

N I it is a front view of the terminal unit in which distribution of 
information is shown. 

[Drawing ISj it is a flow chart which shows the procedure of information storage in 
the server of drawing 5. 

LQ t I§wiD.S..i§J !t iS a f ront view of the terminal unit in which the display of the initial 
screen of DEJABU service is shown. 

[Drawing 17]lt is a front view of the terminal unit in which the display of the 
search results of the relation database in DEJABU service is shown. 
[Drawing 1 8; It is a front view of the terminal unit in which the display of the record 
result by automatic-recording mode is shown. 

[Drawing . 19jlt is a block diagram showing the terminal unit concerning other 
embodiments. 

[Drawing 20] It is a block diagram showing the server corresponding to drawing 
19. 

[Description of Notations] 

1 [ .„, A database20 / .... A terminal unit40 / .... Server ] An information 
processing system2 .... An information acquisition means7 .... A key generation 
means 10 
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